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METHOD AND SYSTEM FOR PRESENTING DIGITAL MEDIA 

CROSS-REFERENCE TO RELATED APPLICATION 
This application claims the benefit of U.S. Provisional Application 
5 No. 60/222,85 1 , filed August 4, 2000. 

FIELD OF THE INVENTION 
The present invention relates generally to methods and systems for presenting 
digital media, and more particularly to methods and systems for presenting digital 
media over the Internet to a person using a personal computer or over a television 
1 0 network to a person using a television equipped with a set-top box. 

BACKGROUND OF THE INVENTION 
The advent of personal computers and access to a world-wide network, such 
as the Internet and World Wide Web, has resulted in individual users having access 
to a wide variety of digital media. Increasingly, this media is also made available to 

15 people using their television equipped with a set-top box. There exist a wide variety 
of user interfaces for providing access to digital media via the Internet and World 
Wide Web. However, these interfaces rely on users being fairly sophisticated with 
computers, computer terminology, and computer operations. Novice computer users 
and users of televisions equipped with set-top boxes can have difficulty using 

20 interfaces requiring a high degree of computer familiarity. In particular, those using 
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set-top boxes usually must rely on conventional television controls, and not the 
keyboard and mouse typically available with a personal computer. 

Accordingly, today's user interfaces for presenting digital media are not 
readily accessible to novice computer users or users of televisions equipped with set- 
top boxes. A need exists to further improve the ease-of-use and presentation of 
digital media, both for the benefit of novice computer users and especially for users 
of televisions equipped with set-top boxes. 

SUMMARY OF THE INVENTION 

In accordance with the present invention, a method and system is disclosed 
for providing a user interface to digital media, such as photographs. The user 
interface presents the digital media using graphical representations of real-world 
environments in which the media is commonly found, such as photo albums, books, 
film strips, framed works of art on walls, etc. The present invention also discloses a 
user interface requiring a minimal number of user inputs, such as cursor direction 
control and selection, for the user to select, edit, and arrange components of the 
presented digital media. 

In accordance with one aspect of the invention, a user interface is provided. 
The interface presents collections of digital media to a user, with the collections 
being presented in a format selected by the user and having arrangements and 
properties determined by the user. The collections of digital media may include 
photographs, with the collections presented as photo albums. Presentation of the 
contents of the photo albums can be determined by the user, and can include 
presentations as an album, as a gallery of pictures, as a storybook having pictures and 
associated text, as a filmstrip, or as a slide show. Selection of individual photographs 
within a collection can be accomplished by user actuation of cursor control and 
selection keys. The interface also includes menus from which operations can be 
selected by use of the cursor control and selection keys. Such operations allow the 
user to create, edit, and arrange collections of digital media, to establish associated 
properties, to input text concerning the media and the user, to view the media, and to 
purchase products incorporating the media. 



QBEO\17566AP.DOC 



-3- 



BRIEF DESCRIPTION OF THE DRAWINGS 
The foregoing aspects and many of the attendant advantages of this invention 
will become more readily appreciated as the same become better understood by 
reference to the following detailed description, when taken in conjunction with the 
5 accompanying drawings, wherein: 

FIGURE 1 is a block diagram depicting a system component overview in 
accordance with an embodiment of the present invention. 
^ FIGURE 2 depicts an interface screen presented to a user in accordance with 

£) an embodiment of the present invention, and depicts collections of photographic 

jT; 10 digital media as photo albums and user-selectable menu options for managing such 
2*. media. 

45= FIGURES 3-6 depict alternative embodiments of the presentation of 

p photographs contained in corresponding photo albums shown in FIGURE 2. 

Jij FIGURE 7 is a flow diagram depicting the menu options available to the user 

ff i 1 5 presented with the interface of FIGURE 2. 

£ FIGURE 8 depicts the interface of FIGURE 2, with a first of the menu 

options having been highlighted. 

FIGURE 9 is a flow diagram depicting a first set of menu operations available 
to the user upon selection of the menu option highlighted in FIGURE 8. 
20 FIGURE 10 is a flow diagram depicting a second set of menu operations 

made available to the user upon selection of a second of the menu options in the 
interface of FIGURE 2. 

FIGURES 11 and 12 depict two alternative slide show presentations in 
accordance with a user selection made from the menu operations of FIGURE 10. 
25 FIGURE 13 is a flow diagram depicting a third set of menu operations made 

available to the user upon selection of a third of the menu options in the interface of 
FIGURE 2. 

FIGURE 14 depicts a menu bar presented to the user of the third set of menu 
operations of FIGURE 13. 
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FIGURE 15 depicts a screen-displayed keyboard presented to the user for 
entry of textual information. 

FIGURE 16 is a flow diagram depicting a fourth set of menu operations made 
available to the user upon selection of a fourth of the menu options in the interface of 
5 FIGURE 2. 

FIGURES 17 and 18 depict photographic enhancement procedures made 
available to the user of the fourth set of menu operations of FIGURE 16. 

FIGURE 19 is a flow diagram depicting a fifth set of menu operations made 
available to the user upon selection of a fifth of the menu options in the interface of 
10 FIGURE 2. 

FIGURES 20-22 depict user interface screens presented to the user of the 
fifth set of menu operations of FIGURE 19. 

DETAILED DESCRIPTION OF THE ILLUSTRATIVE EMBODIMENTS 
In accordance with embodiments of the present invention, a user interface is 

15 provided for presentation of digital media via the Internet and personal computer or 
via a television network (e.g., cable, satellite, DSL, and other television networks) 
and set-top box equipped television. In the following description, certain specific 
details are set forth in order to provide a thorough understanding of various 
embodiments of the present invention. One skilled in the art will understand, 

20 however, that the present invention may be practiced without these details. In other 
instances, well-known functions, features, and operations have not been shown or 
described in detail in order to avoid unnecessarily obscuring the description of the 
various embodiments of the present invention. 

FIGURE 1 is a diagram depicting a system 100 in accordance with an 

25 embodiment of the present invention. The system 100 includes a server 102 that can 
be networked to a set-top box equipped television 104 via a cable television operator, 
or a personal computer 106 via the Internet. The server 102 is also networked with 
digital media providers, such as photo development services 108, via the Internet. 
Server 102 is further networked with providers 110 of commercial products for sale 

30 to users of the set-top box equipped television 104 or personal computer 106. 
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Digital media, such as photographic images, may be uploaded to the 
server 102 either by the users themselves or via the third-party photo development 
services 108. For example, a set-top box equipped television can be connected to a 
digital camera 112 or other means of providing digital photographic information, 
5 such a scanner. Likewise, a user of the personal computer 106 can provide digital 
photo information to the server 102 by use of a digital camera 1 14 or a scanner 116. 
Similarly, the third-party photo developer 108 can employ a scanner 118 or other 

■pr.,7. 

^ source of digital photographic information for provision to the server 102 via the 

O Internet. 

L! 10 As will be understood by those skilled in the art, the server 102 includes an 

interface 120 to users of the set-top box 104 or personal computer 106, including a 
*P translator 122 and servlets 124 for providing the various user interface configuration 

O and environment properties 126 and Web pages or other script sources 128. The 

S server 102 also includes an interface 130 for the commercial product providers 110. 

yi 15 Server 102 also includes digital media handling and management 

£1 functions 132, such as an image handler, image processor, image cache, and cache 

manager, as well as an image provider 1 34 for providing photographic images to the 
user via the interface 120. Likewise, the server 102 includes product provider and 
handler functions 136 and 138, and other object provider and handler functions 140 
20 and 142 for handling product requests from users, as well as receiving and relaying 
product information with the commercial product providers 1 10. Finally, the 
server 102 includes a request dispatcher 144 for relaying and translating media or 
product requests from users of the set-top box 104 or personal computer 106. 

Referring now to FIGURE 2, a user interface screen 200 is depicted for 
25 displaying digital media, such as photographic media, to a user in a familiar 
environmental setting. In this case, the user interface 200 depicts collections of 
digital photographs in the form of a plurality of photo albums 202, 204, 206, 208, and 
210 displayed on a bookcase 212. A currently highlighted one of the photo albums 
(namely, photo album 202) is shown as illuminated by a light 214, and a text 
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region 216 includes a title previously given by the user to the currently highlighted 
photo album. 

The user can choose to highlight a different one of the photo albums by use of 
the right and left cursor control buttons that are commonly found on a television 
5 remote control or keyboard. Alternatively, the user of a personal computer could 
highlight a photo album by use of the computer keyboard cursor controls or a mouse 
or other pointing device. Once highlighted, the user can select the photo album for 
viewing by use of the SELECT (or OK or ENTER or equivalent) buttons commonly 
found on television remote controls in association with the cursor control buttons. 

1 0 Alternatively, the user of a personal computer could, for example, use the ENTER 
key on the keyboard or selection button on the mouse. 

The interface screen 200 also includes a main menu bar 218 having six menu 
options depicted as icons—namely, an album menu option 220, a photo menu 
option 222, a slide show menu option 224, a user profile menu option 226, a 

15 shopping cart menu option 228, and an exit or sign off menu option 230. User 
highlighting and selection of each of these menu display icons 220-230 then allows 
the user to access sets of operations associated with each of these menus, as will be 
described in detail below. The user can move between the photo albums 202-210 
and the menu bar 218 by use of the up and down cursor control buttons/keys that are 

20 commonly found on a television remote control or keyboard. Once the user moves to 
the menu bar 218, different ones of the menu icons 220-230 can be highlighted by 
use of the right and left cursor control buttons/keys. Once highlighted, the user can 
select the corresponding menu option by use of the SELECT button/key (or 
equivalent). The user of a personal computer could effect similar highlighting and 

25 selection functions with a computer keyboard or with a mouse or other pointing 
device, as well understood by those skilled in the art. 

FIGURES 3-6 show different presentations of photographs contained in the 
photo albums 202-210 in FIGURE 2, Each of the photo albums has an associated 
display presentation that is previously determined by the user when creating the 

30 photo album. For example, user selection of photo album 202 results in a gallery 
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display screen 240 shown in FIGURE 3, which displays photographs contained 
within the photo album 202 as framed pictures on a gallery wall. A currently 
highlighted one of the photographs 242 is shown illuminated by a light 244, with a 
text region 246 of the gallery display screen 240 containing a title previously given 
5 by the user to the highlighted photograph, along with a directional indicator 248 
informing the user that additional photographs may be seen. 

The menu bar 218 is also displayed in the gallery display screen 240, and the 
user can choose to highlight and select different ones of the photographs or different 
menu options by use of the cursor control and SELECT buttons as described above. 
10 Selection of a photograph on the gallery display screen 240 can be used to better see 
the photograph, such as by presenting a full screen image of the photograph. 

User selection of the photo album 204 in FIGURE 2 results in an album 
display screen 250 shown in FIGURE 4, which displays photographs as photos in an 
open album. A currently highlighted one of the photographs 252 is shown by an 
15 illuminated frame 254, with a text region 256 of the album display screen 250 
containing a title previously given by the user to the highlighted photograph, along 
with a directional indicator 258 informing the user that additional album pages of 
photographs may be seen. 

The menu bar 218 is also displayed in the album display screen 250, and the 
20 user can choose to highlight and select different ones of the photographs (including 
turning album pages) or different menu options by use of the cursor control and 
SELECT buttons as described above. Selection of a photograph on the album 
display screen 250 can be used to better see the photograph, such as by presenting a 
full screen image of the photograph. 
25 User selection of the photo album 206 in FIGURE 2 results in a storybook 

display screen 260 shown in FIGURE 5, which displays each photograph along with 
text in a storybook format. A currently displayed photograph 262 is shown along 
with associated text 264 previously input by the user. A text region 266 of the 
storybook display screen 260 contains a title previously given by the user to the 



QBEO\17S66AP.DOC 



-8- 



currently displayed photograph, along with a directional indicators 268 informing the 
user that other storybook pages may be seen. 

The menu bar 218 is also displayed in the storybook display screen 260, and 
the user can display different photographs and associated text (i.e., turn the storybook 
5 pages) or choose to highlight and select different menu options by use of the cursor 
control buttons as described above. Selection of a photograph on the storybook 
display screen 260 can be used to better see the photograph, such as by presenting a 
full screen image of the photograph. 

User selection of the photo album 208 in FIGURE 2 results in a filmstrip 

10 display screen 270 shown in FIGURE 6, which displays photographs as images in a 
filmstrip. A currently highlighted one of the photographs 272 is shown by an 
illuminated frame 274. A text region (not shown in FIGURE 6) may be provided on 
the album display screen 270 for containing a title previously given by the user to the 
highlighted photograph. A directional indicator 276 informs the user that additional 

1 5 photographs may be seen. 

Although not shown in FIGURE 6, the menu bar 218 (see FIGURES 2-5) 
may also be displayed in the filmstrip display screen 270, and the user can choose to 
highlight and select different ones of the photographs or different menu options by 
use of the cursor control and SELECT buttons as described above. Selection of a 

20 photograph on the filmstrip display screen 270 can be used to better see the 
photograph, such as by presenting a full screen image of the photograph. 

Referring to FIGURE 7, a flow diagram depicts a main menu 278 
corresponding with the main menu bar 218, along with user selectable 
menus 280-290 corresponding with the menu display icons 220-230, respectively. 

25 Referring to FIGURE 8, the user interface screen 200 of FIGURE 2 is shown, but 
with the album menu option 220 highlighted (note illuminated icon outline 292), and 
the text region 216 including information about operations available upon selection 
of the album menu option. User selection of the album menu option 220 then 
provides the user with a set of operations associated with the album menu 280. 



QBEO\17566AP.DOC 



-9- 



FIGURE 9 is a flow diagram depicting the set of operations made available to 
the user upon selection of the album menu 280. Those skilled in the art will 
understand that these operations may be presented to the user as a selectable toolbar 
(not shown) like the main menu toolbar 218 described above in connection with 
5 FIGURE 8. The operations include viewing album operations 294, album 
administrative operations 296, and exit operations 298 that return the user to the main 
menu 278. User selection of the album administrative operations 296 will then 
provide the user with operations for creating a new album 300, editing an album 302, 
copying an album 304, moving an album 306, and deleting an album 308. These 

10 album administrative operations may likewise be presented to the user as a selectable 
toolbar (not shown). 

Selection of either the album creating or editing operations 300 or 302 then 
provides the user with the ability to enter textual information (such as the album 
name or description), to identify an album category or theme, and to designate age 

15 advisory levels and shared viewing options with designated contacts or groups of 
other users, 

FIGURE 10 is a flow diagram depicting the set of operations made available 
to the user upon selection of the slide show menu 284. Those skilled in the art will 
understand that these operations may be presented to the user as a selectable toolbar 

20 (not shown) like the main menu toolbar 21 8 described above in connection with 
FIGURE 8, The operations include viewing slide show operations 310, slide show 
administrative operations 312, and exit operations 3 14 that return the user to the main 
menu 278. User selection of the slide show administrative operations 312 will then 
provide the user with slide show control operations 316 (such as play, pause, and 

25 stop operations), slide show startup operations 318, and slide show transition 
operations 320, in which the user can set the types of transitions (such as visual or 
sound effects) between photographs displayed in a slide show. These slide show 
administrative operations may likewise be presented to the user as a selectable 
toolbar (not shown). 
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FIGURE 1 1 shows one type of slide show presentation screen 330, in which 
each photograph occupies the full screen, and the slide show may transition between 
photographs at time intervals previously set by the user or by user action with cursor 
control buttons. FIGURE 12 shows a second type of slide show presentation 
5 screen 340, including a text region 342 containing a title given by the user to the 
displayed photograph, along with a directional indicator 344 informing the user that 
additional photographs are available for viewing. The slide show presentation 
screen 340 may also transition between photographs at set time intervals or in 
response to user action with cursor control buttons. The slide show presentation 

10 screen 340 also includes the main menu bar 218, from which the user can highlight 
and select different menu options by use of the cursor control and SELECT buttons 
as described above. Each of the photo albums 202-210 shown in FIGURE 2 can be 
displayed as a slide show, by the user first highlighting the desired photo album and 
then selecting the slide show menu icon 224 in the main menu toolbar 218. 

15 FIGURE 13 is a flow diagram depicting the set of operations made available 

to the user upon selection of the user profile menu 286. The operations include user 
information operations 346, in which the user can set name, e-mail address, and 
password information. Address and billing operations 348 and 350, respectively, are 
provided for the user to set mailing address and billing information. Contacts and 

20 group operations 352 and 354, respectively, are provided for the user to add or delete 
contacts or groups including other users. Finally, exit operations 356 are provided 
for returning the user to the main menu 278. 

FIGURE 14 shows a profile toolbar 360 that is presented to the user upon 
selection of the profile menu icon 226 from the main menu toolbar 218 (see 

25 FIGURE 2). Also included is a text region 362 that includes information about 
operations available upon selection of the currently highlighted icon (note 
illuminated icon outline 364). The profile toolbar 360 has five operations options 
icons, the user selection of which initiate corresponding operations described above 
in connection with FIGURE 13— namely, a user information icon 366, address and 
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billing icons 368 and 370, respectively, contacts and groups icon 372, and an exit 
icon 376. 

As described above in a number of instances, the user is provided the 
opportunity to input textual information, whether descriptions of individual 
5 photographs and albums, or text for photo storybooks, or user profile information, 
etc. In the case of the user of a personal computer, such textual information is 
readily input via the computer keyboard. However, the set-top box equipped 
television user typically has only conventional television controls lacking text input 
P keys. 

y 10 FIGURE 15 depicts a keyboard-text display 380 that is provided to the user 

J! when text entry is required (or desired). The keyboard-text display 380 includes a 

5 category region 382 identifying the type of textual information to be input. In the 

i example shown, the user is prompted for a name, such as when providing textual 

:; information during user information operations 346 in the user profile menu 286 (see 

*! 15 FIGURE 13). The keyboard-text display 380 includes a text region 384 in which the 
■ entered text is displayed. A keyboard region 386 is provided for the user to input text 

characters, with the user highlighting and selecting individual keys within the 
keyboard region by use of the television remote cursor control (e.g., left and right) 
and SELECT buttons. Movement of the text entry point within the text region 384 is 
20 itself controlled by cursor control keys 388 provided as part of the keyboard 
region 386. Finally the user can decide to save or cancel the full text entered in the 
text region 384 by selecting save or cancel buttons 390 or 392, respectively, with 
movement between these buttons and the keyboard region 386 being accomplished 
by use of the television remote cursor control (e.g., up and down). 
25 FIGURE 16 is a flow diagram depicting the set of operations made available 

to the user upon selection of the photo menu 282. Those skilled in the art will 
understand that these operations may be presented to the user as a selectable toolbar 
(not shown) like the main menu toolbar 218 described above in connection with 
FIGURE 8. The operations include viewing photo operations 394, photo 
30 administrative operations 396, photo enhancement operations 398, and exit 
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operations 400 that return the user to the main menu 278. User selection of the photo 
administrative operations 396 will then provide the user with operations to import or 
upload photos 402, edit photos 404 (in which descriptive textual information can be 
entered by the user), copy photos 406, move photos 408, delete photos 410, and 
5 export photos 412. User selection of the photo enhancement operations 398 provides 
the user with operations to optimize photos 414, rotate photos 416, crop photos 418, 
and reduce redeye 420. The photo administrative and enhancement operations may 
likewise be presented to the user as selectable toolbars (not shown). 

FIGURE 17 shows one type of photo optimization display 430, in which the 

10 user is presented with a photograph 432 and an enhanced version 434 for 
comparison. The enhancement process is performed automatically, with the user 
choosing whether to save or cancel the resulting enhanced image, via a save 
button 438 or cancel button 440. In the example shown, the save button 438 is 
currently highlighted (note illuminated icon outline 442) and a text region 444 

15 includes a description of the operations associated with selection of the save button. 
A second type of photo optimization (described below) is made available to the user 
in response to user selection of a start button 436. 

FIGURE 18 shows a second type of photo optimization display 450, in which 
the user is presented with a photograph 452 and an enhanced version 454 for 

20 comparison. In this case, the user can quantitatively rate the comparison of the two 
images by selection of a Worse button 456 or one of a plurality of quantitatively 
better buttons 458 that indicate the degree to which the user believes the enhanced 
photograph to be better. In the example shown, one of the quantitatively better 
buttons 458 is highlighted (note illuminated icon outline 460) and a text region 462 

25 includes a description of the quantitative judgment made by the user upon selection 
of the highlighted button. The user can undo an optimization operation via an undo 
button 462, and can determine whether to save or cancel an enhanced image via a 
save button 464 and a cancel button 466. 
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Photographic enhancement operations can be accomplished according to the 
methods and systems described in International Patent Application 
No, PCT/US99/28676, the disclosure of which is incorporated herein by reference. 

FIGURE 19 is a flow diagram depicting the set of operations made available 
5 to the user upon selection of the shopping cart menu 288. Those skilled in the art 
will understand that these operations may be presented to the user as a selectable 
toolbar (not shown) like the main menu toolbar 218 described above in connection 
with FIGURE 8. The operations include view cart operations 468 and exit 
operations 470 that return the user to the main menu 278. User selection of the view 

10 cart operations 468 will then provide the user with operations to add an item to the 
cart 472, modify an item in the cart 474, remove an item in the cart 476 5 remove all 
items from the cart 478, and checkout operations 480. 

FIGURE 20 depicts a product promotion screen 490 that can be presented to a 
user upon user selection of the add item to cart operations 472. In this display, 

15 particular products (in this example, a cup and an apron) are promoted. The 
display 490 includes product icons 492 which the user can select for consideration of 
a variety of products for potential purchase. The display 490 also includes operations 
icons 494 associated with the shopping cart menu 288, such as view cart 
operations 468, checkout operations 480, and exit operations 470. 

20 FIGURE 21 depicts a product display screen 500, in which a particular 

product is displayed corresponding to a highlighted one of the product 
icons 492-namely 5 a shirt 502 including a photographic image 504. The user 
determines which photograph will be displayed on a product by first highlighting the 
desired photograph and then selecting the shopping cart menu icon 228 from the 

25 main menu toolbar 218 (see FIGURES 2-6). The product icons 492 may vary 
depending on product offerings by vendors in the user's geographical area or other 
vendor criteria. The presented product icons 492 may depend, therefore, on user 
profile information and corresponding product availability. 

Importantly, the product display screen 500 includes a depiction of how the 

30 actual product will look with the selected photographic image, for more realistic and 



QBEO\17566AP.DOC 



-14- 



improved promotion of such products to the user. The product display screen 500 
also includes a text region 506 having a description of the product, and an order 
information region 508 for indicating the type and quantity of the product ordered. 
Operations icons 5 1 0 are also provided for the user to save or cancel an order, or for 
5 promoting other product purchases, such as the depicted highlighted icon and 
associated text prompting the user to also order a card bearing the photographic 
image 504. Such a card could then be sent electronically to user-designated 
recipients, such as via e-mail, along with text entered by the user. Finally, 
FIGURE 22 depicts a cart contents display 520, in which product types, quantity, and 

1 0 purchase information is provided to the user. 

While certain embodiments of the present invention have been illustrated and 
described, it will be appreciated that various changes can be made without departing 
from the spirit and scope of the invention. Other familiar representations of 
photographic images can be employed, such as pictorial calendar displays. The 

1 5 particular embodiments described above relate to digital images, while those skilled 
in the art will appreciate the invention's applicability to other digital media as well. 
For example, collections of digital music media could be depicted as albums or 
compact discs in a jukebox, or a radio tuner with selectable areas for music genre, 
artist index, and album or song index. As a further example, the digital media could 

20 be streaming video content, with graphical representations of video-tape boxes or 
film stills used as selectable representations of the streaming video content. 
Accordingly, the invention is not limited except as by the appended claims. 
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